Electronic device and input control method thereof

ABSTRACT

Various embodiments of the present invention relate to an electronic device and an input control method thereof. The electronic device may include: a touch screen display; a wireless communication circuit; a processor operatively coupled with the touch screen display, the wireless communication circuit, and the connector; and a memory operatively coupled with the processor. The memory may store instructions, when executed, for allowing the processor to render a screen including a plurality of icons in a set format when the electronic device is coupled with the external display device via the connector, and provide data related to the screen to the external display device, wherein the screen is adapted with a first relation in which an entire region of the touchscreen display corresponds to an entire region of the external display device or a second relation in which the entire region of the touchscreen display corresponds to a partial region of the external display device. Additional various other embodiments are also possible.

TECHNICAL FIELD

Various embodiments of the present invention relate to an electronicdevice and an input control method thereof.

BACKGROUND ART

Electronic devices (e.g., a mobile terminal, a smart phone, a wearableelectronic device, etc.) may provide various functions. For example, thesmart phone may provide short-range wireless communication (Bluetooth,Wireless Fidelity (Wi-Fi), Near Field Communication (NFC), etc.), mobilecommunication (3^(rd) Generation (3G), 4^(th) Generation (4G), 5^(th)Generation (5G), etc.), a music or video playback function, an imagecapturing function, a navigation function, or the like.

The electronic device may be coupled with various external devices via adocking device (or directly). For example, the electronic device may becoupled with a television (TV), a monitor, an earphone, a Bluetoothheadset, or the like. When coupled with the external device, theelectronic device may output audio and/or video via at least one of thecoupled external devices.

DISCLOSURE OF INVENTION Technical Problem

Meanwhile, the electronic device may be coupled with an external displaydevice (e.g., a television, a monitor, etc.) having a relatively largescreen to provide an execution environment similar to a desktop PersonalComputer (PC) (hereinafter, a desktop-like environment). For example,the electronic device may provide not a mobile User Interface (UI)optimized for a relatively small screen via the external display devicebut a UI optimized for a relatively large screen such as a PC via theexternal display device. The electronic device may turn the screen off,and may serve as a main body of the desktop PC. The electronic devicemay be used as an input device of the external display device. Forexample, a user may use a touch screen of the electronic device as atouch pad of a notebook computer.

Meanwhile, the electronic device may further support an input using astylus pen (e.g., a drawing input, a writing input, etc.). However, theelectronic device provides the same pen input scheme used in a mobileenvironment without consideration of a desktop-like environment when theexternal display device is coupled, which may cause inconvenience to theuser when using a pen.

Various embodiments of the present invention may provide an electronicdevice capable of providing a pen input in consideration of anenvironment similar to a desktop coupled with an external displaydevice, and an input control method thereof.

In addition, various embodiments of the present invention may provide anelectronic device capable of matching an entire region or partial regionof a touch screen of the electronic device and an entire region orpartial region of an external display device, and an input controlmethod thereof.

Technical Solution

An electronic device according to various embodiments of the presentinvention may include: a housing; a touch screen display exposed througha first portion of the housing; a wireless communication circuit; anelectrical connector exposed through a second portion of the housing; aprocessor operatively coupled with the touch screen display, thewireless communication circuit, and the connector; and a memoryoperatively coupled with the processor. The memory may storeinstructions, when executed, for allowing the processor to: in a firstoperation, display a first screen including a plurality of iconsindicating a plurality of application programs on the display in a firstformat when the electronic device is not coupled with an externaldisplay device; in a second operation, render a second screen includingthe plurality of icons in a second format without displaying the secondscreen on the display when the electronic device is coupled with theexternal display device via the connector, and provide data related tothe second screen to the external display device via the connector sothat the external display device displays the second screen; in a firstmode of the second operation, receive a first touch input via thetouchscreen display, determine first coordinates of the first touchinput, and adapt the second screen with a first relation in which thefirst coordinates correspond to coordinates of an entire region of theexternal display device; and in a second mode of the second operation,receive a second touch input via the touchscreen display, determinesecond coordinates of the second touch input, and adapt the secondscreen with a second relation in which the second coordinates correspondto coordinates of not the entirety but part of the external displaydevice.

A method of controlling an input of an electronic device according to anembodiment of the present invention may include: displaying a firstscreen including a plurality of icons indicating a plurality ofapplication programs on a display in a first format when the electronicdevice is not coupled with an external display device; and rendering asecond screen including the plurality of icons in a second formatwithout displaying the second screen on the display when the electronicdevice is coupled with the external display device via a connector, andproviding data related to the second screen to the external displaydevice via the connector so that the external display device displaysthe second screen. The providing of the data related to the secondscreen to the external display device may include: activating a firstmode to receive a first touch input via a touchscreen display, determinefirst coordinates of the first touch input, and adapt the second screenwith a first relation in which the first coordinates correspond tocoordinates of an entire region of the external display device; oractivating a second mode to receive a second touch input via thetouchscreen display, determine second coordinates of the second touchinput, and adapt the second screen with a second relation in which thesecond coordinates correspond to coordinates of not the entirety butpart of the external display device.

Advantageous Effects of Invention

Various embodiments of the present invention can provide a touch inputand pen input in consideration of an execution environment similar to aPersonal Computer (PC) environment when an external display device iscoupled, thereby improving convenience of a user.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1A and FIG. 1B illustrate a system for providing a desktop-likeenvironment by using an electronic device according to an embodiment ofthe present invention;

FIG. 2 is a flowchart illustrating a method of controlling a pen inputof an electronic device according to an embodiment of the presentinvention;

FIG. 3A to FIG. 3C are an exemplary view illustrating a method ofcontrolling a pen input of an electronic device according to anembodiment of the present invention;

FIG. 4 is a flowchart illustrating a method of controlling a pen inputof an electronic device according to an embodiment of the presentinvention;

FIG. 5A to FIG. 5C are an exemplary view illustrating a method ofcontrolling a pen input of an electronic device according to anembodiment of the present invention;

FIG. 6A to 6C are an exemplary view illustrating a method of controllinga pen input of an electronic device according to an embodiment of thepresent invention;

FIG. 7 is an exemplary view illustrating a method of controlling a peninput of an electronic device according to an embodiment of the presentinvention;

FIG. 8 is an exemplary view illustrating a method of controlling a peninput of an electronic device according to an embodiment of the presentinvention;

FIG. 9 is a flowchart illustrating a method of controlling an input ofan electronic device according to an embodiment of the presentinvention;

FIG. 10A is a block diagram illustrating a structure of an electronicdevice according to an embodiment of the present invention;

FIG. 10B is a block diagram of a program module according to variousembodiments of the present invention; and

FIG. 11 is a block diagram of an electronic device in a networkenvironment according to various embodiments of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, various embodiments of the present invention will bedescribed with reference to the accompanying drawings. In thedisclosure, specific embodiments are illustrated in the drawings andrelevant detailed descriptions are provided, but this is not intended tolimit various embodiments of the present invention to specific forms.For example, it is obvious to those skilled in the art to which thepresent invention belongs that embodiments of the present invention canbe variously changed.

FIG. 1A and FIG. 1B illustrate a system for providing a desktop-likeenvironment by using an electronic device according to an embodiment ofthe present invention.

Referring to FIG. 1A and FIG. 1B, a system according to an embodiment ofthe present invention may include an electronic device 100, a dockingdevice 200, an external display device 300, and an external device 400.

The electronic device 100 according to an embodiment of the presentinvention may be a smart phone, wearable device, tablet PersonalComputer (PC), or the like supporting a desktop extension mode. Herein,the desktop extension mode is a mode in which the electronic device 100,the docking device 200, the external display device 300, and theexternal device 400 are coupled to provide a usage environment (or anexecution environment) similar to a typical desktop PC. For example, theelectronic device 100 may serve as a main body of a typical desktop PCenvironment. The external display device 300 may serve as a monitor. Theexternal device 400 may serve as an input device (e.g., a keyboard, amouse, etc.).

The electronic device 100 according to an embodiment of the presentinvention may display a first screen including a plurality of iconsindicating a plurality of application programs on a touchscreen display130 in a first format, when it is not coupled with the external displaydevice 300.

The electronic device 100 according to an embodiment of the presentinvention may be driven in a desktop extension mode, when it is dockedto the docking device 200 coupled wiredly or wirelessly with theexternal display device 300 (or when it is directly coupled with theexternal display device 300 having the docking device 200 embeddedtherein). The electronic device 100 may provide a user interface similarto a Windows™ OS to the external display device 300 when driven in thedesktop extension mode. For example, the electronic device 100 mayrender a second screen including a plurality of icons in a secondformat, and may provide data related to the second screen to theexternal display device 300 so that the external display device 300 candisplay the second screen. The data may be provided to the externaldisplay device 300 via the docking device 200 (or directly through acable connector which couples the electronic device 100 and the externaldisplay device 300).

The electronic device 100 according to an embodiment of the presentinvention may operate as an input device for receiving a user input(e.g., an input through a touch input and/or a pen 101), without havingto display a screen on the touchscreen display 130, when driven in thedesktop extension mode.

The docking device 200 according to an embodiment of the presentinvention may be a device for docking the electronic device 100. Thedocking device 200 may be coupled with various external devices throughwired communication and/or wireless communication. For example, thedocking device 200 may be coupled wiredly or wirelessly with theexternal display device 300 and the external device 400 (e.g., a mouseand/or a keyboard). Although not shown in FIG. 1A and FIG. 1B, thedocking device 200 may be coupled with a charger, a wired LAN, aUniversal Serial Bus (USB) device, or the like.

The external display device 300 according to an embodiment of thepresent invention may be a display device having a relatively largescreen, compared to the electronic device 100. For example, the externaldisplay device 300 may be a monitor, a television, or the like. Theexternal display device 300 may be coupled with the docking device 200wiredly (e.g., a High Definition Multimedia Interface (HDMI), a DisplayPort (DP), a Universal Serial Bus (USB) type-C) or wirelessly.

The external display device 300 according to an embodiment of thepresent invention may output audio and/or video provided from theelectronic device 100 via the docking device 200 (or directly).

The external device 400 according to an embodiment of the presentinvention may be an input device (e.g., a mouse and/or a keyboard). Theexternal device 400 may be coupled wiredly or wirelessly with theelectronic device 100, or may be coupled wiredly or wirelessly with thedocking device 200.

According to some embodiments, the system may further include a server(not shown) for managing a policy related to the electronic device 100.For example, the server may manage information on whether a 3^(rd) partyapplication (app) and the desktop extension mode are comparable(hereinafter, compatibility information). The compatibility informationmay be updated by being transmitted to the electronic device 100periodically or when the desktop extension mode is executed or whenthere is a user request.

According to some embodiments, the electronic device 100 may be directlycoupled with the external display device 300. For example, theelectronic device 100 may be directly coupled with the external displaydevice 300 having the docking device 200 embedded therein through awired communication circuit or a wireless communication circuit.

FIG. 2 is a flowchart illustrating a method of controlling a pen inputof an electronic device according to an embodiment of the presentinvention, and FIG. 3A to FIG. 3C are exemplary views illustrating amethod of controlling a pen input of an electronic device according toan embodiment of the present invention.

Before detailed descriptions, it is assumed that an electronic device(e.g., the electronic device 100 of FIG. 1A and FIG. 1B) is coupled withan external display device (e.g., the external display device 300 ofFIG. 1A and FIG. 1B) to drive (or execute) a desktop extension mode. Forexample, the electronic device may be directly coupled wiredly orwirelessly (e.g., through a dongle) with the external display device todrive the desktop extension mode. According to some embodiments, theelectronic device may be coupled with the external display device via adocking device (e.g., the docking device 200 of FIG. 1A and FIG. 1B) todrive the desktop extension mode. The docking device and the externaldisplay device may be coupled wirelessly or through a wired cable (e.g.,an HDMI cable, a DP cable, a USB type-C cable, etc.) capable oftransmitting a video and/or audio signal.

Referring to FIG. 2 to FIG. 3C, in operation 201, a processor of anelectronic device according to an embodiment of the present inventionmay detect a detachment of a stylus pen 310 (e.g., the pen 101 ofFIG. 1) attached to the electronic device.

In operation 203, the processor according to an embodiment of thepresent invention may identify whether a hovering input of the styluspen is detected. For example, the processor may identify whether thestylus pen approaches within a set distance from a touchscreen display330 (e.g., the touchscreen display 130 of FIG. 1A) (or whether a valueof capacitance or electromagnetic field exceeds a set reference value).

If it is identified in operation 203 that the hovering input is notdetected, in operation 205, the processor according to an embodiment ofthe present invention may control a touchscreen display in a defaultstate (e.g., a control mode). In the default state, a user may input acommand such as an execution request (e.g., a mouse click, a doubleclick, etc.) and/or a cursor movement via the touchscreen displaysimilarly to a touchpad of a notebook computer.

If it is identified in operation 203 that the hovering input isdetected, in operation 206, the processor according to an embodiment ofthe present invention may further identify whether a drawing input(e.g., an input of moving the stylus pen in contact with the touchscreendisplay) is detected.

If it is identified in operation 206 that the drawing input is notdetected, the processor may proceed to operation 215 to be describedbelow. Otherwise, if it is identified in operation 206 that the drawinginput is detected, in operation 207, the processor according to anembodiment of the present invention may identify whether at least oneapplication (or app) supporting drawing using a stylus pen is running.

According to some embodiments, the operation 203 may be omitted. Forexample, in an embodiment of the present invention, the operation 205for detecting the drawing input may replace the operation 203 fordetecting the hovering input.

If it is identified in operation 207 that the at least one applicationsupporting the drawing is not running, the processor according to anembodiment of the present invention may proceed to operation 407 of FIG.4 described below. Detailed descriptions thereof will be described belowwith reference to FIG. 4.

If it is identified in operation 207 that the at least one applicationsupporting the drawing is running, in operation 209, the processoraccording to an embodiment of the present invention may provide a userinterface capable of selecting whether a window corresponding to therunning application is enlarged (e.g., a full screen mode). For example,as shown in FIG. 3A, the processor may display a popup window 31including an allow menu 31 a and deny menu 31 b regarding theenlargement of the window 301 a.

According to some embodiments, when a plurality of applicationssupporting drawing are running, as shown in FIG. 3B, the processor maydisplay a popup window 33 at one side of a screen to request forselecting one of windows 301 a and 303 corresponding to the plurality ofdrawing applications. The user may select one of the windows 301 a and303 corresponding to the plurality of applications by using a pointingdevice (e.g., a mouse, a keyboard, a pen, etc.).

In operation 211, the processor according to an embodiment of thepresent invention may identify whether the enlargement of the window isallowed. For example, the processor may identify whether the allow menu3 a or the deny menu 31 b is selected. The selection of the allow menu31 a or the deny menu 31 b may be performed by touching a region (e.g.,a region corresponding to the allow menu 31 a or the deny menu 31 b) ofthe touchscreen display 330 with the stylus pen 310. According to someembodiments, the selection of the allow menu 31 a or deny menu 31 b maybe input through another pointing device (e.g., a mouse) coupled withthe electronic device or the docking device.

According to some embodiments, the processor may identify whether thewindow to be enlarged is selected from the plurality of windows 301 aand 303.

If it is identified in operation 211 that the enlargement is denied(e.g., the deny menu 31 b is selected), the processor according to anembodiment of the present invention may proceed to operation 407 of FIG.4 described below.

If it is identified in operation 211 that the enlargement is allowed(e.g., the allow menu 31 a is selected), in operation 213, the processoraccording to an embodiment may match (or map) an application windowenlarged to a full screen and the touchscreen display of the electronicdevice. For example, as shown in FIG. 3C, the processor may enlarge thewindow 301 a displaying a first application screen to a full screen 301b, and may match the screen such that the full screen 301 b of theexternal display device corresponds to the full screen of thetouchscreen display 330. According to some embodiments, the processormay match the screen such that the window 301 a corresponds to the fullscreen of the touchscreen display, without having to enlarge the window301 a to the full screen. Detailed descriptions thereof will bedescribed below with reference to FIG. 6A and FIG. 6B.

In operation 215, the processor according to an embodiment of thepresent invention may identify whether the desktop extension mode ends.For example, the processor may identify whether the electronic deviceand the external display device are decoupled.

If it is identified in operation 215 that the desktop extension modedoes not end, the processor may return to any one of the aforementionedoperations. For example, the processor may return to operation 201 whenthe stylus pen 310 is attached to a recess of the electronic device.When a drawing application ends or a full screen mode ends, theprocessor may return to operation 205.

Otherwise, if it is identified in operation 215 that the desktopextension mode ends, the processor may end the aforementioned pen inputprocedure.

According to some embodiments, operations 203 and 207 may be omitted.For example, the processor may directly proceed to operation 209 afteroperation 201 is performed. In operation 209, the processor may providea UI for selecting whether to enlarge a window corresponding to acurrently running application. According to some embodiments, theprocessor may provide a UI capable of selecting any one of the at leastone drawing application which is installed (or which can be provided) inthe electronic device.

According to some embodiments, operations 209 and 211 may be omitted.For example, if it is identified in operation 207 that one applicationsupporting the drawing is running, the processor may directly proceed tooperation 213.

FIG. 4 is a flowchart illustrating a method of controlling a pen inputof an electronic device according to an embodiment of the presentinvention, and FIG. 5A to FIG. 5C are exemplary views illustrating amethod of controlling a pen input of an electronic device according toan embodiment of the present invention.

Before detailed descriptions, it is assumed that an electronic device(e.g., the electronic device 100 of FIG. 1A and FIG. 1B) is coupledwiredly or wirelessly with an external display device (e.g., theexternal display device 300 of FIG. 1A and FIG. 1B) to drive (orexecute) a desktop extension mode.

Referring to FIG. 4 to FIG. 5C, in operation 401, a processor of anelectronic device according to an embodiment of the present inventionmay detect a detachment of a stylus pen (e.g., the pen 101 of FIG. 1)attached to the electronic device.

In operation 403, the processor according to an embodiment of thepresent invention may identify whether a hovering input of the styluspen is detected. For example, as shown in FIG. 5A, the processor mayidentify whether a stylus pen 510 approaches within a set distance froma touchscreen display 530 (e.g., the touchscreen display 130 of FIG. 1A)(or whether a value of capacitance or electromagnetic field exceeds aset reference value).

If it is identified in operation 403 that the hovering input is notdetected, in operation 405, the processor according to an embodiment ofthe present invention may control a touchscreen display in a defaultstate (e.g., a control mode). In the default state, a user may input acommand such as an execution request (e.g., a mouse click, a doubleclick, etc.) and/or a cursor movement via the touchscreen displaysimilarly to a touchpad of a notebook computer.

If it is identified in operation 403 that the hovering input isdetected, in operation 407, the processor according to an embodiment ofthe present invention may activate a drawing input function (or mode).The drawing input function may use a pen to display information which isinput on the touchscreen display of the electronic device on a screen ofthe external display device in a drawing format. The processor mayvisually notify the user that the drawing input function is activated.For example, when the drawing input function is activated, as shown inFIG. 5B, the processor may perform dimming processing on the screendisplayed on the external display device, and may display a drawing tool51 at one side of the screen to set a line type (straight line, curvedline, dotted line, solid line, etc.), thickness, color, pen point type,or the like.

According to some embodiments, an operation of identifying whether atleast one application (or app) supporting drawing using a stylus pen isrunning may be further included before performing operation 407. If theat least one application supporting the drawing is not running, theprocessor may proceed to operation 407. If the at least one applicationsupporting the drawing is running, the processor may proceed tooperation 209 of FIG. 2 described above.

In operation 409, the processor according to an embodiment may identifywhether a drawing input is triggered. For example, the processor mayidentify whether a stylus pen is moved by at least a set distance (e.g.,0.3 cm) in contact with the touch screen display.

If it is identified in operation 409 that the drawing input is nottriggered, the processor according to an embodiment of the presentinvention may maintain operation 409. According to some embodiments, ifthe drawing input is not triggered for at least a specific time, theprocessor may proceed to operation 405.

If it is identified in operation 409 that the drawing input istriggered, in operation 411, the processor according to an embodiment ofthe present invention may process a drawing input through a pen. Forexample, as shown in FIG. 5B, the processor may display a first line 52a corresponding to a movement of the stylus pen 510 to the externaldisplay device, when the stylus pen 510 freely moves on the touchscreendisplay 530. Although it is shown in FIG. 5B that a second line 52 b isdisplayed on the touchscreen display 530 in response to the movement ofthe pen 510, according to some embodiments, the second line 52 b may notbe displayed on the touchscreen display 530. For example, an outputfunction (a screen display function) of the touchscreen display 530 maybe deactivated, and only an input function may be activated.

In operation 413, the processor according to an embodiment of thepresent invention may identify whether the drawing input is released.For example, the processor may identify whether an input using an inputtool (e.g., a finger) other than the stylus pen is detected, or whetheran input using the stylus pen is not detected for at least a specifictime.

If it is identified in operation 413 that the drawing input is notreleased, the processor according to an embodiment of the presentinvention may return to operation 411. If it is identified in operation413 that the drawing input is released, in operation 415, the processoraccording to an embodiment of the present invention may execute anediting function. According to some embodiments, if the electronicdevice includes a plurality of editing applications, the processor mayprovide (display) a user interface capable of selecting a specificediting application at one side of the external display device.

In operation 417, the processor according to an embodiment of thepresent invention may perform editing. For example, as shown in FIG. 5C,the processor may enlarge a size of the first line 52 a on the externaldisplay device in response to a user input (e.g., a stretch gesture)detected on the touchscreen display 530. The size enlargement of FIG. 5Cis for exemplary purposes only, and embodiments of the present inventionare not limited thereto. For example, the processor may perform editingin various manners such as a size decrease, a color change, a line typechange, a location movement, or the like according to a user's request.

In operation 419, the processor according to an embodiment of thepresent invention may identify whether the editing ends. For example,the processor may identify whether an input is not received for at leasta designated specific time (e.g., 3 seconds). Alternatively, theprocessor may identify whether a set gesture (e.g., a double tap, agesture of drawing a circle, etc.) is input.

If it is identified in operation 419 that the editing does not end, theprocessor may return to operation 417. Otherwise, if it is identified inoperation 419 that the editing ends, the processor may end theaforementioned pen input procedure.

According to some embodiments, orders of operations 407 and 409 may bechanged. For example, the processor may identify whether a drawing inputis triggered (operation 409) if a hovering input is detected, and mayactivate the drawing input function (operation 407) if the drawing inputis triggered.

FIG. 6A to FIG. 6C are exemplary views illustrating a method ofcontrolling a pen input of an electronic device according to anembodiment of the present invention.

Referring to FIG. 6A to FIG. 6C, an electronic device (e.g., theelectronic device 100 of FIG. 1A and FIG. 1B) according to an embodimentof the present invention may match an entire region of a touchscreendisplay with a partial region (e.g., a window region for displaying adrawing application screen) of an external display device. For example,as shown in FIG. 6A, upon detecting a detachment of a pen in a desktopextension mode or upon detecting hovering of the pen, the electronicdevice may display a selection UI 61 including an allow menu 61 a anddeny menu 61 b regarding whether the matching is achieved, at one sideof the external display device. Although the selection UI 61 shown in apopup format in FIG. 6A, this is exemplary purposes only. Therefore,embodiments of the present invention are not limited thereto, and theselection UI 61 may be provided in various manners.

According to some embodiments, when a plurality of drawing applicationsare running, as shown in FIG. 6B, the processor may provide a UI 62 torequest for selecting a window to be matched from windows 601 and 602corresponding to the plurality of applications. A user may select one ofthe plurality of windows 601 and 602 by using a pointing device (e.g., amouse, a keyboard, a pen, etc.).

When the allow menu 61 a of the selection UI 61 is selected in a stateof FIG. 6A, as shown in FIG. 6C, the processor may match an entireregion of a window 603 of the running drawing application and an entireregion of the touchscreen display 630. The window 603 of the applicationmay include a cancel menu 63 at one side to restore a current matchingrelation to a previous state. For example, if the cancel menu 63 isselected, the processor may return to the state of FIG. 6A. According tosome embodiments, when the cancel menu 63 is selected, a selection UImay be displayed to inquire whether to select another application to bematched among a plurality of application or to return to a previousstate (e.g., the state of FIG. 6A).

In a state where an entire region of the external display device ismatched with the entire region of the touchscreen display 630, a peninput on the window 603 may be inconvenient when a size of the window603 is small. However, since a matching relation is changed to match thewindow 603 and the entire region of the touchscreen display 630 in theaforementioned embodiment of the present invention, the user may easilyperform the pen input on the window 603.

FIG. 7 is an exemplary view illustrating a method of controlling a peninput of an electronic device according to an embodiment of the presentinvention.

Referring to FIG. 7, an electronic device (e.g., the electronic device100 of FIG. 1A and FIG. 1B) according to an embodiment of the presentinvention may adjust a ratio of an input range of a touchscreen displayto be equal to a ratio of a matched window. For example, as shown inFIG. 7, the electronic device may match a window 701 a of an externaldisplay device and a partial region of a touchscreen display 730. Thepartial region of the touchscreen display 730 may be set to a maximumsize having the same ratio as a horizontal and vertical ratio of thewindow. In addition, the electronic device may display guide information(e.g., a square box 701 b) on the touchscreen display 730 so that a usercan recognize the partial region matched to the window 701 a. The guideinformation of FIG. 7 is for exemplary purposes only, and embodiments ofthe present invention are not limited thereto. For example, theelectronic device may display the matched partial region and a differentregion in different background color, transparency, or the like.

The electronic device according to an embodiment of the presentinvention may ignore a pen input detected from the different region ofthe touchscreen display 730.

Upon detecting a rotation of the electronic device in a verticaldirection, the electronic device may re-adapt the set input regionsuitable for a vertical screen.

FIG. 8 is an exemplary view illustrating a method of controlling a peninput of an electronic device according to an embodiment of the presentinvention.

Referring to FIG. 8, an electronic device (e.g., the electronic device100 of FIG. 1A and FIG. 1B) according to an embodiment of the presentinvention may set a plurality of input regions in a touchscreen display.For example, as shown in FIG. 8, the electronic device may set inputregions 801 b and 803 b corresponding to windows 801 a and 803 a of aplurality of running drawing applications on a touchscreen display 830.

Upon detecting a rotation in a vertical direction, the electronic devicemay re-adapt the set input region suitable for a vertical screen.

It is described above with reference to FIG. 7 and FIG. 8 that the inputregions 801 b and 803 b of the touchscreen display 830 are set based ona window size and ratio. According to some embodiments, a user mayrandomly designate a size of the input regions 801 b and 803 b of thetouchscreen display 830. For example, when the user selects a partialregion of a running drawing application after executing an input regionset menu, the processor may set at least a partial region of thetouchscreen display 830 by considering a size or ratio of the selectedpartial region. According to some embodiments, the processor may adjusta horizontal and/or vertical size of an input region of the touchscreendisplay 830 in response to the user input. The processor may increase ordecrease a size of the input region of the touchscreen display 830matched in association with a window size of the selected application,for example, based on a user's pinch zoom-in or out. As such, in anembodiment of the present invention, the window of the selectedapplication and the input region of the touchscreen display 830 may havedifferent ratios.

FIG. 9 is a flowchart illustrating a method of controlling an input ofan electronic device according to an embodiment of the presentinvention.

Referring to FIG. 9, in operation 901, an electronic device (e.g., theelectronic device 100 of FIG. 1A and FIG. 1B) according to an embodimentof the present invention may identify whether an external display device(e.g., the external display device 300 of FIG. 1A and FIG. 1B) iscoupled. For example, the electronic device may be directly coupled withthe external display device wiredly or wirelessly, or may be coupledindirectly with the external display device via a docking device (e.g.,the docking device 200 of FIG. 1A and FIG. 1B).

If it is identified in operation 901 that the external display device isnot coupled, in operation 903, the processor may display a first screenincluding a plurality of icons indicating a plurality of applicationprograms in a first format on a touchscreen display (e.g., thetouchscreen display 130 of FIG. 1A, the touchscreen display 330 of FIG.3A to FIG. 3C, the touchscreen display 530 of FIG. 5A to FIG. 5C, thetouchscreen display 630 of FIG. 6A and FIG. 6B, the touchscreen display730 of FIG. 7, the touchscreen display 830 of FIG. 8).

If it is identified in operation 901 that the external display device iscoupled, in operation 905, the processor may render a second screenincluding a plurality of icons in a second format, and may provide datarelated to the second screen to the coupled external display device. Forexample, the processor may drive (or execute) a desktop extension modeupon detecting a connection of the external display device, and mayprovide the data related to the second screen to the coupled externaldisplay device. The data related to the second screen may be data forrendering a home screen of the desktop extension mode on the externaldisplay device. According to some embodiments, the processor may drivethe desktop extension mode in response to receiving of a user input(e.g., a touch on a menu or icon or the like) for driving the desktopextension mode.

In operation 907, the processor according to an embodiment of thepresent invention may adapt the second screen with a first relation inwhich an entire region of the touchscreen display corresponds to anentire region of the external display region or a second region in whichthe entire region of the touchscreen display corresponds to a partialregion of the external display device. For example, the processor mayreceive a first touch input via the touchscreen display, determine firstcoordinates of the first touch input, and drive (activate) a first modefor adapting the second screen with a first relation in which the firstcoordinates correspond to coordinates of the entire region of theexternal display device. As shown in FIG. 3C, in the first mode, thewindow 301 b of the selected application may be displayed in a fullscreen, and the window 301 b of the selected application is matched withan entire region of the touchscreen display 330 to support a drawinginput using a pen.

Alternatively, the processor may receive a second touch input via thetouchscreen display, determine second coordinates of the second touchinput, and drive (activate) a second mode for adapting the second screenwith a second relation in which the second coordinates correspond tocoordinates of not the entirety but part of the external display device.As shown in FIG. 6C, in the second mode, a window 603 of an applicationdisplayed not in a full screen but in a partial region is matched withthe entire region of the touchscreen display 630 to support a drawinginput using a pen.

In operation 909, the processor according to an embodiment of thepresent invention may identify whether the external display device isdecoupled. If it is identified in operation 909 that the externaldisplay device is not decoupled, the processor may return to operation905. If it is identified in operation 909 that the external displaydevice is decoupled, the processor may end the input control procedure.

According to some embodiments, upon receiving a gesture input via thetouchscreen display, the processor according to an embodiment of thepresent invention may switch the first mode to a third mode. As shown inFIG. 5B, in the third mode, a figure (e.g., a curved line) correspondingto the gesture input using the pen may be displayed on a screen (e.g.,the second screen) displayed on the external display device. Forexample, the processor may add a separate window layer on the screen andmatch an entire region of the added window layer and the entire regionof the touchscreen display 330 to support a drawing input using a pen.

The processor may adjust a transparency of a window layer added to theexternal display device to visually notify the user that the drawinginput function is activated, or perform dimming processing on a screenfor displaying a running application. In addition, the processor maydisplay a drawing tool (e.g., 51 of FIG. 5B) at one side of the screento set a line type (straight line, curved line, dotted line, solid line,etc.), thickness, color, pen point type, or the like.

According to various example embodiments of the present invention, amethod of controlling an input of an electronic device (e.g., theelectronic device 100 of FIG. 1A and FIG. 1B) may comprise: displaying afirst screen including a plurality of icons indicating a plurality ofapplication programs on a display in a first format when the electronicdevice is not coupled with an external display device (e.g., theexternal display device 300 of FIG. 1A and FIG. 1B); and rendering asecond screen including the plurality of icons in a second formatwithout displaying the second screen on the display when the electronicdevice is coupled with the external display device via a connector, andproviding data related to the second screen to the external displaydevice via the connector so that the external display device displaysthe second screen. The providing of the data related to the secondscreen to the external display device may comprise: activating a firstmode to receive a first touch input via a touchscreen display (e.g., thetouchscreen display 130 of FIG. 1A and FIG. 1B, the touchscreen display330 of FIG. 3A to FIG. 3C, the touchscreen display 530 of FIG. 5A toFIG. 5C, the touchscreen display 630 of FIG. 6A and FIG. 6B, thetouchscreen display 730 of FIG. 7, the touchscreen display 830 of FIG.8), determine first coordinates of the first touch input, and adapt thesecond screen with a first relation in which the first coordinatescorrespond to coordinates of an entire region of the external displaydevice; or activating a second mode to receive a second touch input viathe touchscreen display, determine second coordinates of the secondtouch input, and adapt the second screen with a second relation in whichthe second coordinates correspond to coordinates of not the entirety butpart of the external display device.

According to various example embodiments, the method may furthercomprise switching the first mode to a third mode upon receiving agesture input via the touchscreen display.

According to various example embodiments, the gesture input may beprovided using a stylus pen (e.g., the stylus pen 101 of FIG. 1A, thestylus pen 310 of FIG. 3A, the stylus pen 510 of FIGS. 5A and 5B).

According to various example embodiments, the method may furthercomprise displaying a user interface of a drawing application program ata partial region of the external display device; and switching the firstmode to the second mode.

According to various example embodiments, the method may furthercomprise: receiving a first user input for selecting the second mode viathe touchscreen display and switching the first mode to the second modeupon receiving the first user input.

According to various example embodiments, the method may furthercomprise: receiving a second user input for selecting the first mode viathe touchscreen display and switching the second mode to the first modeupon receiving the second user input.

According to various example embodiments, the method may furthercomprise: determining whether the stylus pen is detached from a recessconstructed at a housing of the electronic device; and switching thefirst mode to the second mode, based in part on the determination.

According to various example embodiments, the method may furthercomprise: displaying a user interface of a drawing application programat a partial region of the external display device; identifying whetherto enlarge the user interface to a full screen; and enlarging the userinterface to a full screen, in response to allowing of the enlargement.

According to various example embodiments, the method may furthercomprise: displaying a user interface of a drawing application programat a partial region of the external display device; and setting apartial region of the touch screen display as an input region, byconsidering a ratio of a horizontal size and vertical size of the userinterface.

According to various example embodiments, the method may furthercomprise: displaying guide information indicating the set input regionon the touchscreen display.

FIG. 10A is a block diagram illustrating a structure of an electronicdevice according to an embodiment of the present invention, and FIG. 10Bis a block diagram of a program module according to various embodimentsof the present invention.

Referring to FIG. 10A and FIG. 10B, an electronic device 1000 (e.g., theelectronic device 100 of FIG. 1A and FIG. 1B) according to an embodimentof the present invention may include a processor 1010, a memory 1020, atouchscreen display 1030, a communication circuit 1040, an interface1050, and a detection circuit 1060. The electronic device 1000 mayinclude a plurality of electronic components inside a housingconstructing an exterior. The housing may be constructed of at least oneof plastic, glass, and metal.

The processor 1010 may control an overall operation of the electronicdevice 1000. For example, the processor 1010 may be located inside thehousing and may be electrically (or operatively) coupled with thetouchscreen display 1030, the communication circuit 1040, the detectioncircuit 1060, and the memory 1020 to control each of the component ofthe electronic device 1000. The processor 1010 may receive instructionsfrom the memory 1020, and may perform various functions by controllingeach of the components according to the received instructions. Theprocessor 1010 may be a Central Processing Unit (CPU), an ApplicationProcessor (AP), a Micro Control Unit (MCU), a Micro Processor Unit(MPU), or the like. The processor 1010 may be a single-core processor ora multi-core processor. In another embodiment, the processor 1010 may bea multi-processor consisting of a plurality of processors. For example,the processor 1010 may include an Application Processor (AP) and aCommunication Processor (CP). In another embodiment, the processor 1010may include a high-power processor (e.g., AP) and a low-power processor(e.g., MCU, MPU),

The processor 1010 according to various embodiments of the presentinvention may control a pen input in a desktop extension mode. Forexample, the processor 1010 may control various procedures for theaforementioned pen input control.

The memory 1020 may be located inside the housing, and may beelectrically (or operatively) with the processor 1010. The memory 1020may store various programs for operating the electronic device 1000, andmay store data generated or downloaded during the various programs areexecuted. In addition, the memory 1020 may store various commands and/orinstructions for operating the processor 1010. The memory 1020 mayinclude at least any one of an internal memory and an external memory.

According to various embodiments of the present invention, the memory1020 may store various program modules for the pen input control in thedesktop extension mode of the electronic device 1000.

Referring to FIG. 10B, the program module may include, for example, akernel 1021, a framework 1023, an application program (or application)1025, or the like.

According to an embodiment of the present invention, for example, thekernel 1021 may control or manage system resources (e.g., the processor1010, the memory 130, etc.) used to execute an operation or functionimplemented in other programs (e.g., the framework 1023 or theapplication program 1025). According to an embodiment of the presentinvention, the kernel 1021 may include an input device driver 1021 a.The input device driver 1021 a may process input information which isinput from an external input device (e.g., a mouse, a keyboard, atouchscreen, a stylus pen, etc.), and may transfer the processedinformation to an input management module (or input manager) 1023 a ofthe framework 1023.

According to an embodiment of the present invention, the framework 1023may perform, for example, a mediation role so that the applicationprogram 1025 can communicate with the kernel 1021 to exchange data. Theframework 1023 may handle one or more task requests received from theapplication program 1025 according to a priority.

According to an embodiment of the present invention, the framework 1023may include the input management module 1023 a, a window managementmodule 1023 b, and an app management module 1023 c. The input managementmodule 1023 a may process input information transferred from the inputdevice driver 1021 a into information that can be understood in theapplication 1025, and may transfer it to the window management module1023 b and/or the app management module 1023 c. According to anembodiment of the present invention, the input management module 1023 amay process a pen input which is input via the touchscreen display 1030in accordance with a drawing mode (e.g., a first mode, a second mode, ora third mode) when the external display device is coupled. For example,the input management module 1023 a may process a pen input by matching awindow of an application displayed in an entire region or partial regionof the external display device and at least partial region (e.g., anentire region or partial region) of the touchscreen display 1303.

The window management module 1023 b may manage a size change of thewindow of the application. For example, when the user changes the windowto a full screen mode, the window management module 1023 b may changethe window of the application to a full screen, and may transfercorresponding information to the input management module 1023 a and theapp management module 1023 c.

According to an embodiment of the present invention, the applicationprogram 1025 may include, for example, a home, a dialer, a Short MessageService (SMS)/Multimedia Messaging Service (MMS), an Instant Message(IM), a browser, a camera, an alarm, a contact, a voice recognition, ane-mail, a calendar 381, a media player, an album, a health (e.g.,measuring of a physical activity level, a blood sugar level, etc.), adrawing application, or the like. The application program 1025 maydisplay an execution screen through a window corresponding to the entireregion or partial region of the external display device.

The touchscreen display 1030 may be exposed through a first portion ofthe housing, and may provide an input function and an output function.For example, the touchscreen display 1030 may include a touch panel anda display panel. The display panel may be constructed of, for example, aLiquid Crystal Display (LCD), a Light Emitting Diode (LED) display, anOrganic Light-Emitting Diode (OLED) display, a Micro Electro MechanicalSystem (MEMS) display, or an electronic paper display. The touch panelmay detect (or recognize) a change of a physical property (capacity,frequency, etc.) caused by various touch inputs (e.g., a tap, a doubletap, a touch, a touch movement, a multi touch, a pressure touch, etc.)using an input tool such as a stylus pen or the like, and may transferit to the processor 1010. The touch panel may include a first panel (notshown) for detecting a touch using a finger and a second panel (notshown) for recognizing a stylus pen. The touch panel may further includea third panel (not shown) for detecting pressure.

The touchscreen display 1030 according to various embodiments of thepresent invention may turn the screen off when the electronic device1000 is executed in the desktop extension mode. The touchscreen display1030 according to various embodiments of the present invention mayoperate at least a partial region as a touch pad for receiving a userinput when in the desktop extension mode. For example, when a pointingdevice (e.g., a mouse, a touchpad, etc.) is not coupled in the desktopextension mode, the user may use at least the partial region of thetouchscreen display 1030 as the pointing device. At least the partialregion of the touchscreen display 1030 according to an embodiment of thepresent invention may be matched to at least a partial region of theexternal display device. The touchscreen display 1030 according tovarious embodiments of the present invention may visually notify a setinput region, as described in FIG. 7 and FIG. 8.

The communication circuit 1040 may be located inside the housing, andmay perform wired communication and/or wireless communication. Forexample, the communication circuit 1040 may include at least onewireless communication circuit 1041 and/or at least one wiredcommunication circuit 1042.

The wireless communication circuit 1041 may provide a wirelesscommunication connection. For example, the wireless communicationcircuit 1041 may provide WiFi communication and/or Bluetoothcommunication or the like. The wireless communication circuit 1041according to an embodiment of the present invention may support aconnection of an external device such as a keyboard, a mouse, or thelike. For example, the wireless communication circuit 1041 may receive asignal input from the mouse or the keyboard and provide it to theprocessor 1010.

The wireless communication circuit 1041 according to an embodiment ofthe present invention may receive information (e.g., database) forcompatibility of the desktop extension mode with respect to anapplication (or app) installed in the electronic device 1000 from aserver (not shown). The information may be received periodically, orreceived when the desktop extension mode is executed, or received whenthere is a user request.

According to some embodiments, the wireless communication circuit 1041may support a wireless communication connection with an external displaydevice. For example, the wireless communication circuit 1041 may supporta wireless desktop extension mode.

The wired communication circuit 1042 may provide a wired communicationconnection. For example, the wired communication circuit 1042 mayprovide USB communication (e.g., USB type-C). The wired communicationcircuit 1042 according to an embodiment of the present invention maysupport wired communication with the external display device.

In order to display a screen including a plurality of icons on theexternal display device under the control of the processor 1010, thewired communication circuit 1042 according to various embodiments of thepresent invention may render the screen and transmit data related to thescreen to the external display device.

The interface 1050 may be an interface device (e.g., an electricalconnector) for a connection with the external display device or thedocking device. For example, the interface 1050 may be a socket of a USBtype-C protocol.

The detection circuit 1060 may detect a detachment or attachment of astylus pen. The detection circuit 1060 may be a switch which is pressedwhen the stylus pen is attached and released when the stylus pen isdetached, a magnetic sensor for detecting a magnet disposed at one sideof the stylus pen, or the like. According to some embodiments, thedetection circuit 1060 may be included inside the processor 1010.

FIG. 11 is an exemplary view illustrating a network environmentcomprising an electronic device according to an embodiment of thepresent invention

FIG. 11 is a block diagram illustrating an electronic device 1101 (e.g.,the electronic device 100 of FIG. 1A and FIG. 1B, the electronic device1000 of FIG. 10A) in a network environment 1100 according to variousembodiments. Referring to FIG. 11, the electronic device 1101 in thenetwork environment 1100 may communicate with an electronic device 1102via a first network 1198 (e.g., a short-range wireless communicationnetwork), or an electronic device 1104 or a server 1108 via a secondnetwork 1199 (e.g., a long-range wireless communication network).According to an embodiment, the electronic device 1101 may communicatewith the electronic device 1104 via the server 1108. According to anembodiment, the electronic device 1101 may include a processor 1120,memory 1130, an input device 1150, a sound output device 1155, a displaydevice 1160, an audio module 1170, a sensor module 1176, an interface1177, a haptic module 1179, a camera module 1180, a power managementmodule 1188, a battery 1189, a communication module 1190, a subscriberidentification module (SIM) 1196, or an antenna module 1197. In someembodiments, at least one (e.g., the display device 1160 or the cameramodule 1180) of the components may be omitted from the electronic device1101, or one or more other components may be added in the electronicdevice 1101. In some embodiments, some of the components may beintegrated and implemented, for example, such as the sensor module 1176(e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor)embedded in the display device 1160 (e.g., a display).

The processor 1120 (e.g., the processor 1010 of FIG. 10A) may execute,for example, software (e.g., a program 1140) to control at least oneother component (e.g., a hardware or software component) of theelectronic device 1101 coupled with the processor 1120, and may performvarious data processing or computation. According to one embodiment, asat least part of the data processing or computation, the processor 1120may load a command or data received from another component (e.g., thesensor module 1176 or the communication module 1190) in volatile memory1132, process the command or the data stored in the volatile memory1132, and store resulting data in non-volatile memory 1134. According toan embodiment, the processor 1120 may include a main processor 1121(e.g., a central processing unit (CPU) or an application processor(AP)), and an auxiliary processor 1123 (e.g., a graphics processing unit(GPU), an image signal processor (ISP), a sensor hub processor, or acommunication processor (CP)) that is operable independently from, or inconjunction with, the main processor 1121. Additionally oralternatively, the auxiliary processor 1123 may be adapted to consumeless power than the main processor 1121, or to be specific to aspecified function. The auxiliary processor 1123 may be implemented asseparate from, or as part of the main processor 1121.

The auxiliary processor 1123 may control at least some of functions orstates related to at least one component (e.g., the display device 1160,the sensor module 1176, or the communication module 1190) among thecomponents of the electronic device 1101, instead of the main processor1121 while the main processor 1121 is in an inactive (e.g., sleep)state, or together with the main processor 1121 while the main processor1121 is in an active state (e.g., executing an application). Accordingto an embodiment, the auxiliary processor 1123 (e.g., an image signalprocessor or a communication processor) may be implemented as part ofanother component (e.g., the camera module 1180 or the communicationmodule 1190) functionally related to the auxiliary processor 1123. Thememory 1130 may store various data used by at least one component (e.g.,the processor 1120 or the sensor module 1176) of the electronic device1101. The various data may include, for example, software (e.g., theprogram 1140) and input data or output data for a command relatedthereto. The memory 1130 may include the volatile memory 1132 or thenon-volatile memory 1134.

The program 1140 may be stored in the memory 1130 as software, and mayinclude, for example, an operating system (OS) 1142, middleware 1144, oran application 1146.

The input device 1150 may receive a command or data to be used by othercomponent (e.g., the processor 1120) of the electronic device 1101, fromthe outside (e.g., a user) of the electronic device 1101. The inputdevice 1150 may include, for example, a microphone, a mouse, or akeyboard.

The sound output device 1155 may output sound signals to the outside ofthe electronic device 1101. The sound output device 1155 may include,for example, a speaker or a receiver. The speaker may be used forgeneral purposes, such as playing multimedia or playing record, and thereceiver may be used for an incoming calls. According to an embodiment,the receiver may be implemented as separate from, or as part of thespeaker.

The display device 1160 (e.g., the touchscreen display 130 of FIG. 1Aand FIG. 1B, the touchscreen display 330 of FIG. 3A to FIG. 3C, thetouchscreen display 530 of FIG. 5A to FIG. 5C, the touchscreen display630 of FIG. 6A and FIG. 6B, the touchscreen display 730 of FIG. 7, thetouchscreen display 830 of FIG. 8, the touchscreen display 1030 of FIG.10A) may visually provide information to a user of the electronic device1101. The display device 1160 may include, for example, a display, ahologram device, or a projector and control circuitry to control acorresponding one of the display, hologram device, and projector.According to an embodiment, the display device 1160 may include touchcircuitry, or a pressure sensor adapted to measure the intensity offorce incurred by the touch.

The audio module 1170 may convert a sound into an electrical signal andvice versa. According to an embodiment, the audio module 1170 may obtainthe sound via the input device 1150, or output the sound via the soundoutput device 1155 or an external electronic device (e.g., an electronicdevice 1102) (e.g., a speaker or a headphone)) wiredly or wirelesslycoupled with the electronic device 1101.

The sensor module 1176 may generate an electrical signal or data valuecorresponding to an operational state (e.g., power or temperature) ofthe electronic device 1101 or an environmental state external to theelectronic device 1101. The sensor module 1176 may include, for example,a gesture sensor, a gyro sensor, an atmospheric pressure sensor, amagnetic sensor, an acceleration sensor, a grip sensor, a proximitysensor, a color sensor, an infrared (IR) sensor, a biometric sensor, atemperature sensor, a humidity sensor, or an illuminance sensor.

The interface 1177 (e.g., the interface 1050 of FIG. 10A) may support aspecified protocol for coupling with the external electronic device(e.g., the electronic device 1102) wiredly or wirelessly. According toan embodiment, the interface 1177 may include, for example, a highdefinition multimedia interface (HDMI), a universal serial bus (USB)interface, a secure digital (SD) card interface, or an audio interface.

A connecting terminal 1178 may include a connector via which theelectronic device 1101 may be physically connected with the externalelectronic device (e.g., the electronic device 1102). The connectingterminal 1178 may include, for example, a HDMI connector, a USBconnector, a SD card connector, or an audio connector (e.g., a headphoneconnector).

The haptic module 1179 may convert an electrical signal into amechanical stimulus (e.g., a vibration or a movement) or electricalstimulus which may be recognized by a user via his tactile sensation orkinesthetic sensation. The haptic module 1179 may include, for example,a motor, a piezoelectric element, or an electric stimulator.

The camera module 1180 may capture a still image or moving images.According to an embodiment, the camera module 1180 may include one ormore lenses, image sensors, image signal processors, or flashes.

The power management module 1188 may manage power supplied to theelectronic device 1101. The power management module 1188 may beimplemented as at least part of, for example, a power managementintegrated circuit (PMIC).

The battery 1189 may supply power to at least one component of theelectronic device 1101. The battery 1189 may include, for example, aprimary cell which is not rechargeable, a secondary cell which isrechargeable, or a fuel cell.

The communication module 1190 (e.g., the communication circuit 1040 ofFIG. 10A) may support establishing a wired communication channel or awireless communication channel between the electronic device 1101 andthe external electronic device (e.g., the electronic device 1102, theelectronic device 1104, or the server 1108) and performing communicationvia the established communication channel. The communication module 1190may include one or more communication processors that are operableindependently from the processor 1120 (e.g., the application processor(AP)) and supports a wired communication or a wireless communication.According to an embodiment, the communication module 1190 may include awireless communication module 1192 (e.g., the wireless communicationcircuit 1041 of FIG. 10A) (e.g., a cellular communication module, ashort-range wireless communication module, or a global navigationsatellite system (GNSS) communication module) or a wired communicationmodule 1194 (e.g., the wired communication circuit 1042 of FIG. 10A)(e.g., a local area network (LAN) communication module or a power linecommunication (PLC) module). A corresponding one of these communicationmodules may communicate with the external electronic device via thefirst network 1198 (e.g., a short-range communication network, such asBluetooth™, wireless-fidelity (Wi-Fi) direct, or infrared dataassociation (IrDA)) or the second network 1199 (e.g., a long-rangecommunication network, such as a cellular network, the Internet, or acomputer network (e.g., LAN or wide area network (WAN)). These varioustypes of communication modules may be implemented as a single chip, ormay be implemented as multi chips separate from each other.

The wireless communication module 1192 may identify and authenticate theelectronic device 1101 in a communication network using subscriberinformation stored in the subscriber identification module 1196.

The antenna module 1197 may include one or more antennas to transmit orreceive a signal or power to or from the outside. According to anembodiment, the communication module 1190 (e.g., the wirelesscommunication module 1192) may transmit or receive the signal to or fromthe external electronic device through an antenna appropriate for acommunication scheme.

Some of the above-described components may be coupled mutually andcommunicate signals (e.g., commands or data) therebetween via aninter-peripheral communication scheme (e.g., a bus, general purposeinput and output (GPIO), serial peripheral interface (SPI), or mobileindustry processor interface (MIPI)).

According to an embodiment, commands or data may be transmitted orreceived between the electronic device 1101 and the external electronicdevice 1104 via the server 1108 coupled with the second network 1199.Each of the electronic devices 1102 and 1104 may be a device of a sametype as, or a different type, from the electronic device 1101. Accordingto an embodiment, all or some of operations to be executed at theelectronic device 1101 may be executed at one or more of the externalelectronic devices. According to an embodiment, if the electronic device1101 should perform a function or a service automatically, or by arequest, the electronic device 1101, instead of, or in addition to,executing the function or the service, may request at least partassociated with the function or the service to external electronicdevices. The external electronic devices receiving the request mayperform the function requested, or an additional function, and transferan outcome of the performing to the electronic device 101. Theelectronic device 101 may provide the outcome, with or without furtherprocessing of the outcome. To that end, a cloud computing, distributedcomputing, or client-server computing technology, for example, may beused.

According to various example embodiments of the present invention, anelectronic device (e.g., the electronic device 100 of FIG. 1A and FIG.1B, the electronic device 1000 of FIG. 10A, the electronic device 1101of FIG. 11) may comprise: a housing; a touch screen display (e.g., thetouchscreen display 130 of FIG. 1A and FIG. 1B, the touchscreen display330 of FIG. 3A to FIG. 3C, the touchscreen display 530 of FIG. 5A toFIG. 5C, the touchscreen display 630 of FIG. 6A and FIG. 6B, thetouchscreen display 730 of FIG. 7, the touchscreen display 830 of FIG.8, the touchscreen display 1030 of FIG. 10A, the display device 1160 ofFIG. 11) exposed through a first portion of the housing; a wirelesscommunication circuit (e.g., the wireless communication circuit 1041 ofFIG. 10A, the wireless communication module 1192 of FIG. 11); anelectrical connector (e.g., the interface 1050 of FIG. 10A, theconnecting terminal 1178 of FIG. 11) exposed through a second portion ofthe housing; a processor (e.g., the processor 1010 of FIG. 10A, theprocessor 1120 of FIG. 11) operatively coupled with the touch screendisplay, the wireless communication circuit, and the connector; and amemory (e.g., the memory 1020 of FIG. 10A, the memory 1130 of FIG. 11)operatively coupled with the processor, wherein the memory storesinstructions, when executed, for allowing the processor to: in a firstoperation, display a first screen including a plurality of iconsindicating a plurality of application programs on the display in a firstformat when the electronic device is not coupled with an externaldisplay device (e.g., the external display device 300 of FIG. 1A andFIG. 1B); in a second operation, render a second screen including theplurality of icons in a second format without displaying the secondscreen on the display when the electronic device is coupled with theexternal display device via the connector, and provide data related tothe second screen to the external display device via the connector sothat the external display device displays the second screen; in a firstmode of the second operation, receive a first touch input via thetouchscreen display, determine first coordinates of the first touchinput, and adapt the second screen with a first relation in which thefirst coordinates correspond to coordinates of an entire region of theexternal display device; and in a second mode of the second operation,receive a second touch input via the touchscreen display, determinesecond coordinates of the second touch input, and adapt the secondscreen with a second relation in which the second coordinates correspondto coordinates of not the entirety but part of the external displaydevice.

According to various example embodiments, the instructions may allow theprocessor to switch the first mode to a third mode upon receiving agesture input via the touchscreen display.

According to various example embodiments, the gesture input may beprovided by using a stylus pen (e.g., the stylus pen 101 of FIG. 1A, thestylus pen 310 of FIG. 3A, the stylus pen 510 of FIGS. 5A and 5B).

According to various example embodiments, the instructions may allow theprocessor to display a user interface of a drawing application programat a partial region of the external display device, and switch the firstmode to the second mode.

According to various example embodiments, the instructions may allow theprocessor to receive a first user input for selecting the second modevia the touchscreen display, and switch the first mode to the secondmode upon receiving the first user input.

According to various example embodiments, the instructions may allow theprocessor to receive a second user input for selecting the first modevia the touchscreen display, and switch the second mode to the firstmode upon receiving the second user input.

According to various example embodiments, the housing may furthercomprise a recess to which a stylus pen is detachably inserted. Theinstructions may allow the processor to determine whether the stylus penis detached from the recess, and switch the first mode to the secondmode based in part on the determination.

According to various example embodiments, the instructions may allow theprocessor to display a user interface of a drawing application programat a partial region of the external display device, identify whether toenlarge the user interface to a full screen, and enlarge the userinterface to the full screen in response to allowing of the enlargement.

According to various example embodiments, the instructions may allow theprocessor to display a user interface of a drawing application programat a partial region of the external display device, and set a partialregion of the touch screen display as an input region, by considering aratio of a horizontal size and vertical size of the user interface.

According to various example embodiments, the instructions may allow theprocessor to display guide information indicating the set input regionon the touchscreen display.

The electronic device according to various embodiments may be one ofvarious types of electronic devices. The electronic devices may include,for example, a portable communication device (e.g., a smartphone), acomputer device, a portable multimedia device, a portable medicaldevice, a camera, a wearable device, or a home appliance. According toan embodiment of the present invention, the electronic devices are notlimited to those described above.

It should be appreciated that various embodiments of the presentinvention and the terms used therein are not intended to limit thetechnological features set forth herein to particular embodiments andinclude various changes, equivalents, or replacements for acorresponding embodiment. With regard to the description of thedrawings, similar reference numerals may be used to refer to similar orrelated elements. It is to be understood that a singular form of a nounmay include one or more of the things, unless the relevant contextclearly indicates otherwise. As used herein, each of such phrases as “Aor B,” “at least one of A and/or B,” “A, B, or C,” or “at least one ofA, B, and/or C,” may include all possible combinations of the itemsenumerated together. As used herein, such terms as “1st,” “2nd,” “first”or “second” may modify a corresponding components regardless of animportance or an order, be used to distinguish a component from another,and does not limit the corresponding components. It is to be understoodthat if an element (e.g., a first element) is referred to, “(operativelyor communicatively) connected with,” or “connected to” another element(e.g., a second element), it means that the element may be coupled withthe other element directly, or via other element (e.g., a thirdelement).

As used herein, the term “module” may include a unit implemented inhardware, software, or firmware, and may interchangeably be used withother terms, for example, “logic,” “logic block,” “part,” or“circuitry”. A module may be a single integral component, or a minimumunit or part thereof, adapted to perform one or more functions. Forexample, according to an embodiment, the module may be implemented in aform of an application-specific integrated circuit (ASIC).

Various embodiments as set forth herein may be implemented as software(e.g., the program 1140) including one or more instructions that arestored in a storage medium (e.g., internal memory 1136 or externalmemory 1138) that is readable by a machine (e.g., computer). The machinemay invoke instructions stored in the storage medium, be operated toperform functions according to the instructions invoked, and include theelectronic device (e.g., the electronic device 100, the electronicdevice 1000, the electronic device 1001) according to embodimentsdisclosed. If the instructions are executed by a processor (e.g., theprocessor 1010, the processor 1120), the processor may execute functionscorresponding to the instructions directly or using other componentsunder the control of the processor. The instructions may include a codegenerated or executed by a compiler or an interpreter. Themachine-readable storage medium may be provided in the form of anon-transitory storage medium. Wherein, the term “non-transitory” simplymeans that the storage medium does not include a signal and is tangible,but does not differentiate between semi-permanently storing the data inthe storage medium and temporarily storing the data in the storagemedium.

According to an embodiment, a method according to various embodiments ofthe present invention may be included and provided in a computer programproduct. The computer program product may be traded as a product betweena seller and a buyer. The computer program product may be distributed inthe form of a machine-readable storage medium (e.g., compact disc readonly memory (CD-ROM)), or be distributed online via an application store(e.g., PlayStore™). If distributed online, at least part of the computerprogram product may be temporarily generated or at least temporarilystored in the machine-readable storage medium, such as memory of themanufacturer's server, a server of the application store, or a relayserver.

According to various embodiments, each component (e.g., a module or aprogram) may include a single entity or multiple entities, and a part ofthe above-described components may be omitted, or other components maybe added. Alternatively or additionally, the part of components (e.g.,modules or programs) may be integrated into a single component, and maystill perform a function of each component in the same or similar manneras they are performed by each component before the integration.According to various embodiments, operations performed by the module,the program, or another component may be carried out sequentially, inparallel, repeatedly, or heuristically, or at least part operation maybe executed in a different order or omitted, or other operations may beadded.

The embodiments disclosed in the present invention are suggested foreasy explanation and understanding of the disclosed technical features,and are not intended to limit the scope of the present invention.Therefore, the scope of the present invention should be interpreted asincluding all changes or modified forms derived based on the technicalidea of the present invention.

1. An electronic device comprising: a housing; a touch screen displayexposed through a first portion of the housing; a wireless communicationcircuit; an electrical connector exposed through a second portion of thehousing; a processor operatively coupled with the touch screen display,the wireless communication circuit, and the connector; and a memoryoperatively coupled with the processor, wherein the memory storesinstructions, when executed, for allowing the processor to: in a firstoperation, display a first screen including a plurality of iconsindicating a plurality of application programs on the display in a firstformat when the electronic device is not coupled with an externaldisplay device; in a second operation, render a second screen includingthe plurality of icons in a second format without displaying the secondscreen on the display when the electronic device is coupled with theexternal display device via the connector, and provide data related tothe second screen to the external display device via the connector sothat the external display device displays the second screen; in a firstmode of the second operation, receive a first touch input via thetouchscreen display, determine first coordinates of the first touchinput, and adapt the second screen with a first relation in which thefirst coordinates correspond to coordinates of an entire region of theexternal display device; and in a second mode of the second operation,receive a second touch input via the touchscreen display, determinesecond coordinates of the second touch input, and adapt the secondscreen with a second relation in which the second coordinates correspondto coordinates of not the entirety but part of the external displaydevice.
 2. The electronic device of claim 1, wherein the instructionsallow the processor to switch the first mode to a third mode uponreceiving a gesture input via the touchscreen display.
 3. The electronicdevice of claim 2, wherein the gesture input is provided by using astylus pen.
 4. The electronic device of claim 1, wherein theinstructions allow the processor to: display a user interface of adrawing application program at a partial region of the external displaydevice; and switch the first mode to the second mode.
 5. The electronicdevice of claim 4, wherein the instructions allow the processor to:receive a first user input for selecting the second mode via thetouchscreen display; and switch the first mode to the second mode uponreceiving the first user input.
 6. The electronic device of claim 5,wherein the instructions allow the processor to: receive a second userinput for selecting the first mode via the touchscreen display; andswitch the second mode to the first mode upon receiving the second userinput.
 7. The electronic device of claim 1, wherein the housing furthercomprises a recess to which a stylus pen is detachably inserted, andwherein the instructions allow the processor to: determine whether thestylus pen is detached from the recess; and switch the first mode to thesecond mode, based in part on the determination.
 8. The electronicdevice of claim 1, wherein the instructions allow the processor to:display a user interface of a drawing application program at a partialregion of the external display device; identify whether to enlarge theuser interface to a full screen; and enlarge the user interface to thefull screen, in response to allowing of the enlargement.
 9. Theelectronic device of claim 1, wherein the instructions allow theprocessor to: display a user interface of a drawing application programat a partial region of the external display device; and set a partialregion of the touch screen display as an input region, by considering aratio of a horizontal size and vertical size of the user interface. 10.The electronic device of claim 9, wherein the instructions allow theprocessor to display guide information indicating the set input regionon the touchscreen display.
 11. A method of controlling an input of anelectronic device, the method comprising: displaying a first screenincluding a plurality of icons indicating a plurality of applicationprograms on a display in a first format when the electronic device isnot coupled with an external display device; and rendering a secondscreen including the plurality of icons in a second format withoutdisplaying the second screen on the display when the electronic deviceis coupled with the external display device via a connector, andproviding data related to the second screen to the external displaydevice via the connector so that the external display device displaysthe second screen, wherein the providing of the data related to thesecond screen to the external display device comprises: activating afirst mode to receive a first touch input via a touchscreen display,determine first coordinates of the first touch input, and adapt thesecond screen with a first relation in which the first coordinatescorrespond to coordinates of an entire region of the external displaydevice; or activating a second mode to receive a second touch input viathe touchscreen display, determine second coordinates of the secondtouch input, and adapt the second screen with a second relation in whichthe second coordinates correspond to coordinates of not the entirety butpart of the external display device.
 12. The method of claim 11, furthercomprising switching the first mode to a third mode upon receiving agesture input via the touchscreen display.
 13. The method of claim 11,further comprising: displaying a user interface of a drawing applicationprogram at a partial region of the external display device; andswitching the first mode to the second mode.
 14. The method of claim 11,further comprising: determining whether the stylus pen is detached froma recess constructed at a housing of the electronic device; andswitching the first mode to the second mode, based in part on thedetermination.
 15. The method of claim 11, further comprising:displaying a user interface of a drawing application program at apartial region of the external display device; identifying whether toenlarge the user interface to a full screen; and enlarging the userinterface to a full screen, in response to allowing of the enlargement.16. The method of claim 12, wherein the gesture input may be providedusing a stylus pen.
 17. The method of claim 13, further comprising:receiving a first user input for selecting the second mode via thetouchscreen display; and switching the first mode to the second modeupon receiving the first user input
 18. The method of claim 17, furthercomprising: receiving a second user input for selecting the first modevia the touchscreen display; and switching the second mode to the firstmode upon receiving the second user input.
 19. The method of claim 11,further comprising: displaying a user interface of a drawing applicationprogram at a partial region of the external display device; and settinga partial region of the touch screen display as an input region, byconsidering a ratio of a horizontal size and vertical size of the userinterface.
 20. The method of claim 19, further comprising: displayingguide information indicating the set input region on the touchscreendisplay.